Accurate Per-Flow Measurement with Bloom Sketch

نویسندگان

  • Yang Zhou
  • Hao Jin
  • Peng Liu
  • Haowei Zhang
  • Tong Yang
  • Xiaoming Li
چکیده

Sketch is a probabilistic data structure, and is widely used for per-flow measurement in network. The most common sketches are the CM sketch and its several variants. However, given a limited memory size, these sketches always significantly overestimate some flows, exhibiting poor accuracy. To address this issue, we proposed a novel sketch named the Bloom sketch, combining the sketch with the Bloom filter, another well-known probabilistic data structure widely used for membership queries. Extensive experiments based on real IP traces show that our Bloom sketch achieves up to 14.47× higher accuracy compared with the CM sketch, while exhibiting comparable insertion and query speed. Our source code is available at Github [1].

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Diamond Sketch: Accurate Per-flow Measurement for Real IP Streams

Existing sketches often have low memory efficiencies when performing per-flow measurement tasks on skewed IP streams. In this paper, we propose Diamond Sketch, a novel sketch that dynamically assigns an appropriate number of atom sketches to each flow on demand, improving the accuracy considerably while keeping a comparable speed.

متن کامل

Four-wire orthogonal structure for accurate measurement of fluid velocity and wind flow direction using silicon micro-machining on silicon nitride membranes

Microelectromechanical thermal sensors are one of the most accurate and important tools for measuring the direction and velocity of an acoustic wave and winds. Detection of wind direction and speed in different ranges has different applications such as meteorology, wind power plants, gas flow measurement in smart building and gas consumption of power plants. In this paper, a four wires sensor i...

متن کامل

Identifying Frequent Flows in Large Traffic Sets through Probabilistic Bloom Filters

In many network applications, accurate traffic measurement is critical for bandwidth management and detecting security threats such as DoS (Denial of Service) attacks. In such cases, traffic is usually modeled as a collection of flows, which are identified based on certain features such as IP address pairs. One central problem is to identify those “heavy hitter” flows, which account for a large...

متن کامل

18.415 Project - Using a Count-Min sketch structure for easier analysis of Bloom filter false positive rates

The classical proof for Bloom filter false positive rates was shown to be incorrect due to a subtle error regarding independence of events. Although the previously computed false positive rate is asymptotically still correct, it is incorrect for small parameter values and is generally only a lower bound [BGK08]. Indeed, the correct analysis for Bloom filters does not admit a convenient closed f...

متن کامل

Twin Plate Weir: A Flow Measuring Device (TECHNICAL NOTE)

For efficient use of water, accurate measurement of flow in (field/laboratory) channels is required for many water resource projects. The present work is aimed to study the flow characteristics of a twin plate weir (two sharp-crested plates are placed one behind the other at some distance) under free and submerged flow conditions. Experiments are performed with four spacing of the twin plate we...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2018